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ABSTRACT 

We reexamine the constraints on mixing between electron and muon or tau neutrinos 
from shock-reheating and r-process nucleosynthesis in supernovae. To this end neutrino fla- 
vor evolution is described by nonlinear equations following from a quantum kinetic approach. 
This takes into account neutrino forward scattering off the neutrino background itself. In 
contrast to other claims in the literature it is shown that a sound self-consistent analytical ap- 
proximation can in the first place only be performed in the adiabatic limit where phase terms 
are suppressed. In the cosmologically interesting mass range below about 25 eV the resulting 
mixing parameter bounds are between one and two orders of magnitude less restrictive than 
limits neglecting neutrino contributions. Extensions to the non-adiabatic regime derived in 
the literature usually neglect coherence effects from phases. To check their importance nu- 
merical simulations of the evolution equations were performed in this regime. They indicate 
that analytical approximations for the flavor conversion efficiencies can indeed be extended 
by neglecting phase terms. This allows more stringent bounds similar to the ones derived 
in earlier work. These bounds depend to some extent on the adopted supernova model and 
tend to be somewhat less restrictive in the mixing angle but simultaneously extend to smaller 
mixing masses compared to limits neglecting the neutrino induced potential. 



1 Introduction 



Neutrino oscillations became interesting in astrophysics not least because of the MSW ef- 
fect JT| which due to a cancellation of a small vacuum mixing term and a flavor dependent 
forward scattering amplitude can lead to medium enhanced conversion between different 
neutrino flavors. For suitable mixing parameters this effect offers a solution to the solar neu- 
trino problem |2], |3], ^, |5| . Medium enhanced neutrino oscillations were also discussed in the 
circumstance of supernova explosions || |7|, [| || . As long as the neutrino densities are much 
smaller than the electron density, as in the sun and in the outer envelope of a supernova, 
neutrino forward scattering off the neutrino background itself can safely be neglected in the 
MSW analysis. In the opposite extreme case, however, it has been demonstrated for the case 
of neutrino mixing in the early universe that interactions among the neutrinos can change 
the character of the oscillations drastically ||10||. 



There has been a discussion [|TT| 12, |H| whether similar effects could be important for 
oscillations among v e and or v T neutrinos in the hot bubble region above the neutri- 
nosphere after supernova core bounce. This is especially important since allowing r-process 
nucleosynthesis in this region to work a few seconds after core bounce forbids possible res- 
onance transitions of the more energetic or v T neutrinos into v e neutrinos to occur with 
high efficiency |J. It is one of the rare astrophysical situations where neutrino masses rel- 
evant for cosmological hot dark matter candidates, between 1 eV and 100 eV, play a role. 
Furthermore it has been suggested || that oscillations between the neutrinosphere and the 
outward going shock could have an important impact on the delayed shock heating mecha- 
nism itself. Ref. [0 contains an extensive discussion of the bounds on neutrino mixing which 
can be derived by considering these two situations. However, their approach suffers in part 
from the presence of ambiguous oscillation phases which are hard to implement analytically. 
We therefore found it worth to reexamine this problem by a combination of analytical and 
numerical work. 

In section 2 we set up the flavor evolution equations for this problem as they follow 
from a quantum kinetic description of neutrino oscillations. In section 3 we describe the 
physical situation in the postbounce supernova during the parts of the cooling phase which 
are relevant to us. Section 4 reexamines the case of highly adiabatic neutrino oscillations 
where ambiguous oscillation phases are suppressed allowing an analytical approach for the 
transition efficiency. Reliability and model dependence of the resulting bounds on the mixing 
parameters are discussed. In section 5 we perform numerical simulations and show that 
analytical estimates for flavor conversion efficiencies can still be used to extend these bounds 
to the nonadiabatic regime. We summarize our results in section 6. 



2 Quantum Kinetic Flavor Evolution 



As was shown in Ref. [14] an ensemble of neutrinos and antineutrinos consisting of N rel- 
ativistic mixed flavors can be described by a set of iV x N density matrices p p and p p 
(overbarred quantities refer to antineutrinos from now on), one for each momentum mode p. 
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The ith diagonal term represents the occupation number for neutrinos of flavor i in this mode 
whereas the off diagonal terms describe the coherence of the mixing flavors. The evolution 



equations for the p p were given in Ref. [I3| in the most general case. For the problem under 
consideration here various simplifications can be applied. 

First, we restrict ourselves to two flavor mixing between the electron neutrino and the 
muon or tau neutrino. The transformation between the flavor eigenstates v e and on the 
one hand and the mass eigenstates v\ and v 2 on the other hand is then characterized by the 
vacuum mixing angle 9 via 



v e \ _ / cos 9 — sin 9 
v.. I \ sin 9 cos 9 




(i; 



where we adopt the convention that 9 < tt/4. Matter induced resonances can lead to 
proton rich conditions (i.e. the number of electrons per baryon Y e is bigger than 0.5) in 
r-process nucleosynthesis if they occur for neutrinos but not for antineutrinos ||. In the 

ml > where m 12 are the mass eigenvalues 



m 



above convention this is the case if A 
corresponding to V\^_. 

Furthermore, for A < 10 4 eV 2 the resonances occur well above the neutrinosphere where 



nonforward scattering and thus oscillation damping []T5[ is negligible. Thus we can restrict 
ourselves to the coherent effects caused by forward scattering off of electrons, nucleons, nuclei 
and the neutrinos themselves. 

In order to write the evolution equations in a convenient way we write the density matrices 
p p in terms of polarizations P p and Pauli matrices r 



Pp 



(2) 



where n p = Tr(p p ). An analogous definition holds for antineutrinos. Since for the mixing 
parameters under consideration the oscillation length is always short compared to the scale 
height of the neutrino density we can write down the evolution equations for the P p in the 



form [16 1 



^P 

ds p 



V2G F N e - cos 29 



V2G F J dq(l - cos# pq ) (n q P q - n q P c 



x P p (3) 



[notation <iq = <i 3 q/(27r) 3 ]. Here, s is the length measured along the path of a neutrino in 
mode p, Gp is Fermi's constant, N e = N e - —N e + is the difference of the electron and positron 
densities N e - and N e + and 6*^ is the angle between p and q. Only terms CP-odd in the 
background enter the effective potential; the CP-even contributions which can be important 
in the early universe are negligible here. The term in big braces on the r.h.s. of Eq. (|3]) can 
be regarded as the effective potential and depends on s explicitly via N e as well as implicitly 
via P p . The latter fact renders Eq. ([3]) a nonlinear differential equation for the polarizations 
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Pp in the individual modes which experience resonances where the third component of this 
effective potential vanishes. 

In principle, there is also an equation for the antineutrino flavor evolution but as we will 
see below even if one takes into account the neutrino contribution to their effective potential 
the antineutrinos never experience resonances. Therefore, for small vacuum mixing angles 
the fast oscillating antineutrino contribution to the effective potential of the neutrinos can 
be averaged over. 

For a fixed energy E = |p| neutrinos from different directions will resonate at different 
positions. This tends to wash out the oscillation phases and the distribution functions in 
energy space. Assuming a spherically symmetric supernova the latter effect is negligible 
since the neutrinos are almost radially free streaming. In the adiabatic limit where phases 
play no role it is therefore a good approximation to substitute s by the radius r and cos # pq 
by its flux averaged value F(r). This leads to an equation which only depends on E: 



dr 



V K x P, 



■m sin2d 



V V2G F N e - A cos 26 



V2G F F(r){P -P) 



x P, 



(4) 



The self-interaction term in the effective potential reduces to a product of the difference of 
the total neutrino and antineutrino flavor polarizations P — P = / c/q(n q P q — ^ p P p ) and 
the geometric factor F(r) which for radii r large compared to the neutrinosphere radius r ns 
is given by |T| 

m = \ iff ) 2 ■ (5) 

Beyond the adiabatic regime the problem is in principle two dimensional and the one di- 
mensional simplification Eq. (f|) tends to exaggerate the influence of coherent phase effects. 
However, since we want to demonstrate that even strong coherence effects do not change 
conversion efficiencies considerably we can still use Eq. (|4j) as an extreme case complemen- 
tary to the approach in Ref. [12] which neglected phases entirely. Therefore, Eq. ([|) will be 
the basic equation from which we start our analysis below. 



3 Shock-Reheating Epoch and Hot Bubble Phase 

The energy spectrum F Q (E) (in units of number density per energy) of the different neutrino 
species a = z/ e , u e , assuming no oscillations is given by numerical supernova models and 
is proportional to r™ 2 in the free streaming region. The spectra of u^, v T and v T are equal 
to that of v^. One generic feature is that the luminosity L is the same for all species within 
about 10%. However, the average energies are different. The total number densities N a are 
then inverse proportional to (E a ). On the other hand, F u (E) > F Ue (E) for E > 20MeV 
because the muon and tau neutrinos have higher average energy. This is the reason why 
adiabatic resonance transitions between u e and or v T would lead to more high energetic 
electron neutrinos. As already mentioned in the introduction there are two interesting phases 
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to distinguish during cooling of the newly born neutron star where this effect could play an 
important role. 

First, around 0.15 sec after core bounce the high neutrino luminosity L ~ 5 x 10 52 erg/ sec 
is expected to help reenergize the stalled shock and lift it outward 0. Due to charged current 
reactions with nucleons and nuclei the electron neutrinos play the main role in this process. 
Since the corresponding cross sections are proportional to the square of the electron neutrino 
energy resonant conversion of muon or tau neutrinos with energies > 25 MeV into electron 
neutrinos could make shock revival more efficient. 

R-process nucleosynthesis takes place a few seconds after core bounce which constitutes 
the phase we are interested in in this paper. In this case resonant conversion between v e 
and or v T would lead to proton rich conditions in r-process nucleosynthesis |J and the 
cooling supernova remnant would thus be lost as a site for this process to occur efficiently. For 
treating this phase we will use L ~ 10 51 erg/ sec as well as Fermi-Dirac neutrino distributions 
with (E Ue ) ~ 11 MeV, (E Pe ) ~ 16 MeV and (E Vl \ ~ 25 MeV, respectively, and vanishing 
chemical potential. 



4 Analytical Approach in the Adiabatic Limit 

In this section we assume in the first place that the transitions are adiabatic, then calculate 
the effective potential from which we derive the adiabaticity index self-consistently and finally 
put constraints on this index. This is not the same approach as adopted in Ref. JTTJ where 
the neutrino induced potential was treated as a small perturbation and results in different 



conclusions. A similar but more laborious approach than ours was adopted in Ref. |T2 
To begin with let us define 

N a (E)= f E dE'F a (E'), (6) 



o 



and the total number density N a = N a (oo) for all neutrino species a. In the adiabatic limit 
the evolved energy dependent polarizations appearing in Eq. (f|) are given by 

_ FJE)-FJE) ( 8i ' 12 *™ \ 

= { J 29m J ' (7) 

with an analogous equation for antineutrinos with an overall sign change. Here, the also 
energy dependent mixing angle 9 m in the medium is formally given by the components of 
the effective potential Ve in Eq. (|), 

sin 2u„ 



and will self-consistently be determined below in Eq. (0). An analogous expression holds 
for the antineutrino medium mixing angle 9 m . 
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It should be noted that in cases different from the adiabatic limit the column vector in 
Eq. (0) has to be replaced by 

1 12 cos 26 m cos a \ 



( (l-2P LZ )sin2# m + 2[P LZ (l 



V 



-2 [P lz (1-Plz; 
;i-2P LZ )cos2# m -2[P LZ (l- 



' Plz)] 

il/2 • 

J sin a 
-P LZ )] 1/2 sin20 r , 



(9) 



, cos a ) 

where a is a phase which builds up at and beyond the resonance and Plz is the (Landau- 
Zener) transition probability between mass eigenstates at the resonance which therefore 
characterizes its adiabaticity. Obviously, modes near resonance contribute most to the first 
and second component of total polarization P which enters into the effective potential. For 
Plz not near to or 1 the phase dependent term can be important compared to the phase 
independent term. The analytical treatment of this section is therefore completely safe only 
in the adiabatic limit Plz "C 1 where Eq. (0) is a good approximation. For the general case 
we will resort to numerical modeling in the next section. It should be stressed that even if 
for some reason the phase dependent terms should average out (which is not clear since in 
the nonadiabatic case the phases near resonance are of order unity by definition) in contrast 
to the claim in Ref. Eq. @ still contributes a nonvanishing off diagonal component to 
the effective potential in the flavor basis. 

Coming back to the adiabatic case the third component of the effective potential can be 
written as 



Vy 



E3 



V2G F N cS -£-cos26 
Ah/ 



(10) 



Here the effective density iV e fj including the neutrino background itself is defined as follows: 
At a given radius r a specific mode with energy E r = E r {r) will be in resonance, i.e. Ve^{t) = 
0. Then, without knowing the exact energy dependence of the medium mixing angle for 
small vacuum mixing angles we can use that 9 m — > for E < E T , 9 m — > it for E > E r and 
cos20 m ~ 1 for all energies at radius r. Using this in Eq. (|J) yields the approximation 



N eS (r) = N e + P(r) N Ve - N Pe + 2N u (E r ) - 2N Ue (E T ) 



where we suppress the r dependence of all number densities on the r.h.s. Note that in this 
expression E T has to be considered as a function of r. The first term in Eq. (|TT|) is given by 
N e = Y e p/rriN (m^ is the nucleon mass) with Y e ~ 0.4 the number of electrons per baryon 
and p(r) the density profile for which we take the one given in Ref. || for the hot bubble 
phase. 

In order to proceed with the off diagonal part of the effective potential let us first formally 
define the "off diagonal density" 



N od (r) 



F(r) 



J o °° dE [sin2£ m (F^(E) - F Ue (E)) + sm26 m (Pp M (P) - F 9e (E))] . (12) 



sin 29 

Then using Eq. (f|) we can write the first component of the effective potential as 



V, 



El 



V2G F N od -— ) sin 20. 



(13) 
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We now choose a specific neutrino mode with energy Eq which resonates at r = ro, i.e. 
Eq = E r (r ). Then using Eqs. ®, ([T0|) and (p~3f) allows us to write down an expression for 
9 m at r = r where Vs o3 (r ) = 0: 



sin 29 



sin 20 



' E/Eq-1 
\2V2G F EN od /A~l 



' cos 2 26 + sin 2 29 



1/2 



(14) 



An analogous equation with an effective sign change of E holds for 9 m . Inserting Eq. flliD 
into (|T2D results in a nonlinear equation for N Q & which has to be solved after determining 
the resonance point from the condition VE o3 (r ) = 0. As opposed to Ref. fill this is not a 
perturbative approach for small N Q a but completely self-consistent. In the adiabatic limit it 
consists of the solution of two nonlinear equations. Apart from the step function approxi- 
mation for the medium mixing angle it is a more compact formulation of the treatment in 
Ref. 
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We can now define the effective adiabaticity coefficient for mode Eq within this self- 
consistent evolution as 



7eff 



V 2 



dV Eo3 /dr 



V 2 
v e i 



n> 



V2G F {dN eS /dr 



(15) 



where N e s as a function of r is given by Eq. ([□]). This coefficient depends on Eq. For 
r-process nucleosynthesis the most relevant modes are the high energy ones where F v (E) > 
F Ve (E). We therefore chose Eq = 30MeV as a typical energy in the above equations. 

Requiring 7 e fj > 3 ensures that the phase dependent terms in Eq. (||) are suppressed by at 
least a factor 5 compared to the phase independent terms and also allows a comparison with 
the bounds derived in Ref. |12] . For the model parameters given in section 3 this condition 
leads to the excluded region in the A — sin 2 29 space to the right of the thick solid line 
shown in Fig. 1A. Within a first order approximation one could adopt the adiabatic limit for 
neutrinos with energies less than E even for 7 eff < 3 (for a more accurate approach in the 
nonadiabatic case see Ref. |L2| ) and average over all phases in Eq. @ . One could then extend 
the bound down to 7 e fr = 0.23 (corresponding to the critical Plz = 0.7 of Ref. 0) which 
leads to the thin solid line in Fig. 1A. In section 5 we will argue that it is indeed possible 
to extend the analytical approach in this way. The dashed and dotted lines in Fig. 1A 
correspond to 7 e g = 0.23 and 7 e fr = 3, respectively, neglecting neutrino contributions to the 
effective potential. Their influence is demonstrated by comparing respective curves to the 
same 7 e fj. The dashed line corresponds to the limit from Ref. [H. The results are similar to 
the ones obtained in Refs. || [T^j. 

It should be mentioned that Eqs. (|T2"D, (|I41) can have multiple solutions, especially for 
small A. This leads to an uncertainty of typically a factor 2 to 3 in the bound on sin 2 29 
for A < 100 eV 2 . These bounds depend of course also on the actual model adopted for 
the hot bubble phase. As an illustration of this dependence Fig. IB was calculated for 
the same model parameters as Fig. 1A apart from a neutrino luminosity increased by a 
factor 2 which could well be within the uncertainty of actual supernova models. In this case 
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flavor conversion becomes less adiabatic mainly because the self-consistent resonance position 
moves inward where the electron density profile gets considerably steeper. This leads to less 
stringent bounds on sin 2 29, an effect which is largest for small A. For A ~ 1 eV 2 the bound 
is weakened by more than a factor 10. It should also be mentioned that the turnover at low 
A of the bounds including the neutrino induced potential turns out to be sensitive to the 
density profile and could be uncertain within a factor of about 3. 

Finally, we note that a similar analysis can be performed for the shock reheating epoch 
by adopting a suitable density profile for this earlier phase. As in Ref. [12] it turns out that 
neutrino self-interactions have a negligible influence on critical mixing parameters derived in 
this situation. We will therefore not consider this situation further here. 



5 A Numerical Model 

In order to test the analytical approach and extend the analysis to the nonadiabatic case 
we have set up a numerical model. As already seen in the analytical section neutrino self- 
interactions play a negligible role during the shock-reheating epoch. We will therefore restrict 
ourselves to the r-process nucleosynthesis phase in this section. 

To start with, for a fixed energy Eq we define ro in this section as the "zeroth order" 
resonance point determined by neglecting self-interactions, i.e. as the solution of the equation 

V2G F N e = ——cos26. (16) 

Furthermore, we define a suitable variable u = k(r — r ) with 

k = 1 ' 1 W S[n2e= ' iV e/^e| ro COt20 (17) 

(a prime denotes derivative with respect to r), where the adiabaticity parameter 7 is given 

The usual MSW resonance width corresponds to Am = 2 in this coordinate. Next, we 
have to discretize Eq. in energy space. To this end we define central values E*. = 
E (l + ktan28/d) of equally wide energy bins for k = —n, ■ ■ ■ ,n where d determines the 
bin width AE = E tan26/d. Since the energy resolution should at least be of the order 
of the energy range over which neutrinos resonate within one resonance length, d should be 
not smaller than ~ 0.5. As we will show below the results of the simulations do not depend 
sensitively on d as long as d > 0.5. For the total polarization P appearing in Eq. (|j) we 
write 

P = + #„„) EttfiPi , (19) 
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where the sum runs over all modes taken into account and 



Ei+AE/2 
Ei-AE/2 



dE 



F Ue (E) + F V (E) 



(20) 



N Ve + N K 

Taking everything together and approximating N e (r) linearly at the resonance Eq. (§) trans- 
forms into 

— Eq/ Ei 



-w + cot 20(1 -E /Ei 
where the self-coupling constant g is defined by 



d 

du 



Pi = 7 



+ 



^ WnPn 

sin2f9y 



x P, 



(21) 



9 = F(r ) 



(22) 



For notational simplicity antineutrinos were neglected in this derivation. In principle one 
can include the antineutrino contribution in an analytical way by substituting N e — > N c g = 
N e + F(r) (Npf, ~ ^p e ) because antineutrinos encounter no resonances and cos2# m ~ 1. 
Under the same approximations and for not too high neutrino luminosities this leads to 
only a moderate change in the parameters 7 and g and leaves the generic form of Eq. ( fHl) 
unchanged. We also neglected the radial dependence of the nonlinear term in Eq. ( pT|) which 
can become important for \u\ ^> 1/ sin 26. In the simulations below this can only influence 
the low energy neutrinos which encounter resonances at highly negative u. However, because 
low energy neutrinos in general tend to be converted more adiabatically than high energy 
ones the transition at high energies is quite insensitive to the situation at highly negative u 
as long as this transition is not too nonadiabatic. The same remark holds for the sensitivity 
to deviations of the electronic density slope N e (r) from the linear approximation far from 
u = 0. 

The coupled multi mode nonlinear differential equations ( pTf ) have to be integrated on an 
interval [u m m, M max ] chosen such that all modes taken into account encounter their resonances 
within this interval. As initial conditions we choose flavor eigenstates, 

. F Ue (Ei) - F v (Ei 



Mr 



e 3 



(23) 



(e 3 is the unit vector into the positive 3-direction). For small vacuum mixing angles a suitable 
measure for the nonadiabatic transition probability for high energy neutrinos is then given 
by 

1 / „,, r~D t„. m \ 

(24) 



Pr 




Ei>E 



Mr 



J2Ei>E W i [Pj( M min)]3 / 

For numerical simulations based on Eq. (^1|) sin 2 29, 7 and g are the natural parameters. 
In the actual problem for given sin 2 29 the concrete values of 7 and g in terms of A are given 
by Eq. (|1^) and Eq. (p2[), respectively. As in the analytical section we have chosen E = 
30MeV but the results do not change considerably for Eq in the interval [25 Me V, 30 Me V]. 
We basically consider two cases in the following. 
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5.1 Simulations in the Adiabatic Limit 



To become familiar with typical properties of solutions to Eq. (|21|) we first choose parameters 
corresponding to mixing near the boundary of the adiabatic regime. Here the computational 
effort is less than in the nonadiabatic regime. Adopting the model described in section 3 
the mixing parameters A = 5eV 2 and sin 2 29 = lead to 7 ~ 5, g ~ 1 at the resonance 
point. Its location is determined by taking electrons and antineutrinos (in the analytical 
way described above) into account. These parameters serve as input values for Eq. (|21~1) . 
For the simulation shown in Fig. 2A the energy interval spanned by the modes taken into 
account is [20 MeV, 40 MeV] . This simulation was actually performed for both d = 1 and 
d = 2 resulting in P r = 0.155 and P r = 0.148 (Fig. 2A shows only the d = 2 case). This 
demonstrates insensitivity of our results to d. Figs. 2B and 2C were therefore produced for 
d — 1. Fig. 2B is based on the same parameters as Fig. 2A except that the self-coupling 
g was enhanced by a factor 2. For the simulation shown in Fig. 2C, which was done for 
exactly the same parameters as Fig. 2B, more modes were taken into account corresponding 
to an energy interval [12.5 MeV, 40 MeV]. This led to a considerably decreased P r = 0.137 
compared to the case in Fig. 2B. 

Figs. 2 demonstrate two common features which we observed within the parameter range 
considered in our simulations: First, increasing g while keeping all other parameters fixed 
tends to decrease the adiabaticity of flavor conversion. Second, taking more low lying energy 
modes into account for fixed other parameters tends to increase adiabaticity which depends 
roughly logarithmically on the energy interval spanned by the modes taken into account. This 
second feature is indeed what would be expected from the analytical estimate [Eqs. fli~2]) and 
(|j~3|)l of the effective adiabaticity parameter Eq. flTBl) : At least as long as iV d ^ N e s (which is 
the case for the model parameters presented in section 3) modes with F U ^(E) > F Ue (E), i.e. 
with E > 20 MeV tend to decrease 7 e g whereas low energy modes tend to increase it. Because 
these low energy modes are considerably higher occupied we expect to underestimate the 
adiabaticity for the energy intervals chosen in our simulations. This also nicely demonstrates 
that the numerical problem is nonlocal in energy space, i.e. in principle all modes with 
considerable occupation have to be followed. This has to do with the energy dependence of 
the medium mixing angle which enters into the integral in Eq. ([12]). 

In any case in the examples to Figs. 2 P r is always considerably smaller than 0.5. This 
confirms that A = 5eV 2 , sin 2 29 = 10~ 3 can be excluded as already predicted by the conser- 
vative analytical bounds (see thick solid line in Fig. 1A). 

5.2 Simulations in the Nonadiabatic Case 

The second mixing parameter combination we consider, A = 10 eV 2 , sin 2 29 = 10 -4 is not 
excluded by the conservative analytical bound but is barely excluded by a naive extension 
of these bounds (see thin solid line in Fig. 1A) and also by the bounds derived in Ref. [|T2"|. 



Within our numerical framework these mixing parameters correspond to 7 ~ 1 and g ~ 1.5. 
Based on our discussion of the previous simulations we expect a simulation for 7 = 1, g = 2 
on an energy interval [13 MeV, 39 MeV] to underestimate adiabaticity. The results are shown 
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in Figs. 3. From Fig. 3A it can be seen that in this case individual modes oscillate a lot 
in a seemingly chaotic way due to the strong inter-mode coupling. Nevertheless there is 
a continuous transformation of high energy muon neutrinos into electron neutrinos until 
the last mode has gone through its resonance. This is shown by the evolution of the third 
component of the neutrino induced effective potential V v $ in Fig. 3B. Also shown in this 
figure is a typical transverse component of the effective potential Vp- Its high values during 
conversion of neutrinos in low energy modes causes the conversion to be much more adiabatic 
in these modes than in the higher energy modes as already mentioned earlier. In any case 
since P r = 0.500 this simulation demonstrates that A = 10 eV 2 , sin 2 29 = 10~ 4 still violates 
the condition Plz > 0.7 necessary for r-process nucleosynthesis to work in supernovae 0. 

It also turns out that an analytical expression of the kind of Eq. (p~5|) still gives a rough 
estimate of 7 e fj and P r in these simulations. This indicates that analytical estimates for flavor 
conversion efficiencies can still be used to extend the mixing parameter bounds based on r- 
process nucleosynthesis to the nonadiabatic regime. The resulting bounds depend somewhat 
on the supernova model and are similar to the thin solid lines in Figs. 1 or the bounds derived 
in Ref . |g . 

Finally, it should be mentioned that runs performed with only the flavor diagonal part 
of the effective potential taken into account lead to substantially different behaved solutions 
and transition efficiencies. This demonstrates nicely that the off diagonal refractive index 
revealed by the quantum kinetic approach has direct physical consequences. 



6 Conclusions 

We have analyzed oscillations among electron and muon or tau neutrinos in the hot bub- 
ble region above the neutrinosphere after supernova core bounce. We have shown that in 
the adiabatic limit conservative bounds on the mixing parameters can be derived from an 
analytical approach including neutrino self-interaction contributions to the self-consistent 
effective potential. These bounds concern neutrino masses between about 1 eV and 100 eV 
where neutrinos could serve as hot dark matter. Because in the lower mass range these 
limits are one to two orders of magnitude less restrictive than former limits which neglected 
neutrino contributions we explored the parameter range beyond these bounds by numerical 
simulations. That way it was demonstrated that analytical estimates of flavor transition 
probabilities can be extended within sufficient accuracy to the nonadiabatic regime as was 
done in earlier work neglecting phase effects. The resulting bounds are therefore similar to 
the ones derived in Ref. [fT^] . This conclusion is in contrast to Ref. [|Il|] where it was claimed 
that due to the oscillation phases reliable constraints can not be derived for mixing masses 
smaller than about 25 eV. We also commented on the dependence of the resulting bounds on 
the actual supernova model adopted, especially the neutrino luminosity and the density pro- 
file. Compared to former limits on neutrino mixing based on calculations only incorporating 
the electronic part to the effective potential these bounds tend to be slightly weakened in 
the mixing angle but at the same time extend to somewhat lower mixing masses. 
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Figure Captions 



Figure 1A: Exclusion plot in the A — sin 2 26 plane. The area to the right of the thick 
solid line (corresponding to 7 e fr = 3) is excluded by the analytical approach of section 4. 
This is regarded as a safe bound. The thin solid line corresponds to a naive extension (see 
section 4) of the analytical bound down to 7 e g = 0.23 (Plz — 0.7). These lines are similar to 



corresponding bounds in Ref. |12[]. The dotted line corresponds to 7 e fr = 3 without taking 
self- interaction effects into account. For comparison with Ref. the dashed line corresponds 
to Plz = 0.7 with the same parameters used but again without self- interactions taken into 
account. The turnover at low A of the solid lines is sensitive to the density profile and could 
be uncertain by about a factor 3. 

Figure IB: Same as Figure 1A but for a neutrino luminosity L increased by a factor 2. 
As discussed in section 4 this demonstrates the dependence of the analytical bounds on the 
supernova model. 

Figure 2A: Numerical simulation of the model of section 5 with 7 = 5, g — 1, sin 2 26 = 10~ 3 
and d = 2. 41 energy modes equidistant on the interval [20 Me V, 40 Me V] were taken into 
account. The three curves show the evolution of the third polarization component to the 
20, 30 and 40MeV energy mode, respectively, in direction of decreasing initial value for P3. 



The quantity P r defined in Eq. (24) measuring the level crossing probability at high energies 
relevant for r-process nucleosynthesis is given by P r = 0.148. 

Figure 2B: Same as Figure 2A but for d = 1 (21 modes) and a self-coupling g increased by 
a factor 2 leading to an enhanced P r = 0.301. This demonstrates the dependence of 7^ on 
the supernova model. 

Figure 2C: Same as Figure 2B except that the oscillations were followed on the larger 
energy interval [12.5 MeV, 40 MeV] corresponding to 29 modes. The curve to the lowest 
energy has a positive initial value for P3 because electron neutrinos are more abundant at 
these energies. The result P r = 0.137 is smaller compared to the previous case for reasons 
discussed in the text. 

Figure 3A: Numerical simulation of the model of section 5 with 7 = 1, g = 2, sin 2 26 = 10~ 4 
and d = 0.5. 43 energy modes equidistant on the interval [13 MeV, 39 MeV] were taken into 
account. The three curves show the evolution of the third polarization component to the 
13, 30 and 39 MeV energy mode, respectively, in direction of decreasing initial value for P 3 . 
The quantity P r defined in Eq. (j24"D measuring the level crossing probability at high energies 
relevant for r-process nucleosynthesis is given by P r = 0.500. 



Figure 3B: Evolution of the effective potential as defined in Eq. (|2l"D for E = 30 MeV for 
the simulation on which Fig. 3A is based on. Shown are the first component V\ (dotted line), 
the modulus of the tangential component Vr (solid line) and the neutrino contribution to 
the third component V u3 (dashed line). Note that due to Eq. ( f2T| ) the resonance position of 
the mode to energy E satisfies u = cot 20(1 — E /E) + V u3 (u). 
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